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ABSTRACT 



Tutoring has been widely accepced as a remedy for academic deficiencies. 
Yet. actual short-and long-range results of tutorial programs are seldon ex- 
amined. In this study 201 students from four associate degree nursing pro- 
grams received tutorial assistance in freshman courses. Results indicated 
that 1) students and tutors perceived tutoring as helpful in learning course 
material. 2) a higher proportion of tutored students received satisfactory 
grades than did controls. 3) students who attended ten or more tutorial 
session, obtained higher grades than students who attended sessions less 
frequently. 4) State Board Examination scores of tutored and control groups 
were not significantly different, and 5) attrition rates of tutored and con- 
trol groups were not significantly different. 



MULTIPLE CRITERIA FOR EVALUATING TUTORIAL EFFECTIVENESS 
IN A TWO-YEAR NURSING PROGRAM 



The need to reduce the dropout rate in nursing education is Quite urgent, 
up to one-half of the students who are admitted to associate degree nursing 
.rorrams fail to graduate (Council of Baccalaureate and Higher Degree Programs. 
1970). Walsh (1972) stated that it is essential to work for iiaprovement in 
the quality of nursing education as well as for increased number, of nurses. 
At a time when nursing staff shortages are felt in manv hosnitals throughout 
the United States, the loss of potential nurses is quite critical. 

Students often do not complete their nursing education because of academic 
deficiencies. Taylor et al (1966) reviewed l8 studies of dropouts in schools 
of nursing. In 13 of the l8 studies, failure in course work was shown to be 
the number one reason for student withdrawals. 

Many institutions, including nursing schools, have focused attention on 
students who have academic difficulties. Several different t,.es of remediation 
programs have been developed and implemented: pre-college enrichment sessions, 
group and individual counseling, diagnostic evaluations, help for special 
difficulties, tutoring, and various combinations of these programs. 

An^ong remediation programs, tutoring has been extolled by msny as an 
optimum educational arrangement (Shaver i Nuhn. 1971). Community centers, 
poverty agencies, local colleges, and high schools have frequently sponsored 
tutorial programs (Losak. 1972). Advocates of remedial program, desire to offer 
each student the opportunity to develop his individual capacities - academic, 
vocational, and personal - as completely as possible. 

Education, National Institutes of Health. 
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Although it is generally assumed that students profit from tutoring programs, 
systematic data to confim the claimed effects are seldom gathered. Where 
atte.-:ipts are made to evaluate effectiveness of tutoring, several measurement 
proolems occur. Losak (1972) stated that cont-ol groups are frequently not 
used in studies of remedial programs. Often leaders of remedial programs feel 
it "unethical" to deny students enrollment in a program that is believed to be 
good for them. Without the use of one or more control groups, it is impossible 
to make valid comparisons (Campbell & Stanley, 1966). Matching sub.lecto on one 
or more variables is generally the most frequently used method *«• constructing 
control groups. Although matching has many disadvantages, Kerlinger (1965) 
stated that it can be useful if there is a substantial correlation between the 
matching variables (5) and the dependent variable. Another problem in eval- 
uations of tutorial programs is the use of only one criterion or outcome measure. 
Tutorial p^-ograms involve a variety of processes and outcomes. Hsnce, using only 
one measure to .ludge the value of a lorogram is inaioprOToriate at best. 

This study was designed to evaluate a tutorial program for associate 
dejrree nursing students using multiple and short - and long - range assess- 
ment criteria. 

Method 

Sub.T ects . 

The 201 students who participated in the tutorial program were enrolled 
at four Indiana University associate degree nursing programs. All four schools 
of nursing have been accredited by the National League for Nursing. All of 
the students who participated were admitted in 1971 and 1972. All students 
-.fere freshman at the time they were tutored, and all but two were females. 
Procedure . 

Courses. In 1970-1971 an attempt was made to identify freshman courses in 
which many students received poor or unsatisfactory grades. The director of 



each school of nursing was asked to identify courses in which students at her 
campus had the most difficulty. Students records were then examined to de- 
termine the courses in which students received the (treatest number of D's 
and F's. The five freshman courses thus identified included anatcnjy, physiology, 
microbiology, psycho3ofy, and fundamentals of nursing. The preventive 
remedial instruction wae limited to these first-year courses, since few 
students who survive the first year fail courses in the second year. 

Student selection . Information for predicting student grades in specific 
freshman courses were gathered for full-time students entering each school of 
nursing in 1970, 1971, and 1972. These data were obtained from student 
academic records and from a 90-minute administration of several tests and 
questionnaires. Predictor variables used included: high school rank, high school 
grade averages in math, science, and English courses; overall high school 
grade average; amount of previous education; probation status at time of 
admission; general test and anxiety; creativity; reading and vocabulary; and 
student's stated lowest acceptable grade for ea^h of the freshman courses 
(Miller, 191^). 

Data gathered from students entering in the 1970-1971 academic school year 
were used to develop multiple regression equations for predicting course 
grades for students entering in the 1971-1972 school year. In a similar 
manner, data collected in the 1971-1972 school year were used to predict student 
grades during the 1972-1973 school year. The levels of predictability for the 
five freshman courses remained about the same for the two years. The multiple 
P's ranged from a low of .Ul to a high of .87 with ax» average somewhere around 
.65. Operational validations for each regression equation with students from 
the following year revealed some shrinkage. These validations ranged between 
.1^ and .57 end averaged about .U2. 
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The following procedure was used to assign students to either the 
experimental or control condition. Once a course was designated for tutoring ♦ 
the multiple regression equation developed from student data in the previous 
year was used to predict student grades in that particular course. Students 
were then ranked on the basis of their predicted grades. Systematic selection 
was carried out by starting at the bottom of the list , and assigning every 
other student to either the experimental (tutorin/) or control condition until 
the group quotas of five students were filled. Assignment of students to either 
experimental or control conditions was done for specific courses. 

Students in the control group attended regular Glasses and used assist- 
ance normally available at each school of nursing. Students in the experimental 
group attended regular classes but also participated In special remedial 
tutoring sessions. These two groups were observed throughout the two years 
of the nursing program and until they took the State Board Examination (SBE). 

During orientation week in 1971 and 1972, students were informed by h 
memo that special tutorial classes would be organized during the coining 
school year. At the testing session, students were advised that tutoring 
would involve a small number of students on an experimental basis; and If the 
tutorial groups were successful, the university might develop plans to make 
tutoring available to more students wishing to enroll. Nursing students who 
had been randomly selected by the procedures described above were 
invited to attend tutoring sessions . They were told that they had been randomly 
selected and that the tests had indicated they would profit from the sessions. 
More than half of the students (69*) who were invited to attend perticipated 
in the program. 
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Tutoring . Tutorial sessions were held in summer, fall, and spring semesters 
at each campus over a two-year period. Tutoring groups were formed by the first 
or second week of each semester and met once a week for two hours for the 
duration of the semester. Tutoring was done by instructors fsxniliar with the 
course content. Bnphasis was placed on covering material tested in the class- 
room. The averape number of students in a group was three and ranged from 
two to six students per group. Students attended approximately B0% of the 
tatoried sessions. 
Evaluation Criteria 

A number of criteria were used to assess outcomes of the tutorial program: 
tutor and tutee evaluations of tutoring, course grades, scores on the State 
Board Examination, and attrition rates. 

Questionnaires . At the end of each semester, tutors and students responded 
to questionnaires specially developed for this study. The Tutor Questionnaire 
contained 2U items concerning their preparation for tutoring sessions, methods 
used while tutoring, and contact with students. Tutors were also asked to 
comment on special problems and ways to improve the tutoring program. On the 
Tutee Questionnaire, students responded to 2U items dealing with tutor pre- 
paration, tutor attitude, and overall helpfulness of the tutoring sessions. 

Course grades. Comparisons of experimental (tutored) and control groups 
were done for final course grades. Four chi-square contingency tables (2x2) 
were developed comparing the number of tutored students who received satisfactory 
grades (A's, B's, or C's) and unsatisfactory grades (D's or F's) with control 
students in these same categories. Comparisons were done for science courses 
including anatomy, physiolopy, and microbiology; for psychology courses; for 
nursing courses and for all of the three areas combined. 
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A further breakdown was done to assess the relationship between students' 
attendance at the tutoring sessions and their final grade for the course being 
tutored. Two 2 x 2 chl-square analyses were performed. One was used to 
determine whether students vho were present for B0% or more tutoring sessions 
obtained a greater frequency of satisfactory grades than those who were present 
less than SO'Ji of the sessions. The other analysis was done to compare course 
grades of students who attended ten or more tutoring sessions with grades of 
students attending fewer than ten sessions. Both analyses were necessary since 
the various tutorial groups met for different nv rs of sessions. 

SBF scores . The State Board Examination is administered three times a 
year by the State of Indiana for nurse licensxire. Graduates of associate 
degree n\irslng programs are required to take and pass the SBE to be licensed 
as a registered nurse. The majority of nursing students who entered one of 
the four schools of nursing in 1971 took the SBE in the summer of 1973. 
Students entering in 1972 generally took this examination in the summer of 
107U. The five areas of this examination Include: (a) Medical Nursing, 
(b) Surgical Nursing, (c) Pediatric Nursing, (d) Obstetric Nursing, and (e) 
Psychiatric Nxirsing. Scores for each area are standardized with a mean of 
500 and standard deviation of 100. Nursing graduates scoring below 350 in 
any area must retake that section of the SBE until they pass. Analysis of 
verlance was used to examine the dlfferenees betv^en tutored ana control 
groups for the five SBE areas. 

Att rition rate . Information was secxired for all students concerning with- 
drawal or continuation in the program at the end of each semester. Chl-square 
analysis was used to assess the effectiveness of tutoring in terras of attrition. 
Tutored and control students were compared on the basis of whether they re- 
mained to complete the program or whether they dropped out. 



Results 

Questionnaire . 

One hundred and sixty-two Tutee Questionnaires were returned by students 
who participated in tutoring. The item on this questionnaire most closely 
related to tutoring effectiveness was, "Was the tutor helpful in learning 
material in the course?" Of the l62 students who responded, 78 (1»8^) replied 
"Very Much," 57 (35^) replied "Quite a Bit," 25 (1555) replied "Very Little." 

M 2 (1%) replied "None." Th\is approximately B3% of these students felt 
the tutoring had helped them either very much or quite a bit. 

A total of 35 Tutor Questionnaires were rettumed by the tutors. The item 
on this questionnaire similar to the one rated by students read, "Do you think 
you helped the students in learning the material of the course?" Of the 35 
responses, 7 (20%) replied "Very Much", 23 (66^) replied "Quite a Lot," 
5 {lk%) replied "Very Little," and no one replied "None". Thus B6% felt they 
helped very much or a lot. 
Coxirse Grades . 

Analyses were carried out to assess the effectiveness of the tutoring 
pr~'^ram in terms of grades earned in courses. For all courses combined, 19% 
of the tutored students and 6l% of the control students received satisfactory 
grades. Chi-square analysis indicated that this difference was significant 
(Chi-square « ll».55, df » 1, p<.Ol). 

A breakdown and analysis ty type of course revealed that students tutored 
in science courses received a greater number of satisfactory grades and fewer 
unsatisfactory grades than did the non-tutored group, (Chi -square ■ 11.28, 
df » 1, p<.Ol). Comparisons for psychology and nursing courses revealed no 
significant differences between grades of the tutored and control groups 
(Chi-square « .1*0, df ■ 1, N.S.; and Chi-square ■ 1.86, df ■ 1 , N.S. , respectively) 

iO 
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Of those students present for 60% or more tutorial sessions, 11% received 
satisfactory grades in the tutored courses while 11% of those present for less 
than B0% of the sessions obtained grades of A, B, or C. Chi-square analysis 
indicated that this difference was not significant ( Chi-square = .15, df « 1, 
N.S.) Analysis of course grades by number of times present at tutoring sessions 
revealed different results. Approximately 8B% of the students who attended 
ten or more tutoring sessions received satisfactory grades vhile 66% of the 
students attending less than ten cessions received grades of A, B, or C. 
This difference was significant (Chi-square = U.78, df = 1, p<.05). 
SBE Scores . 

One-way ANOVA was used to evaluate the effect of the tutorial program 
in each of the five SBE areas. Although tutored students scored higher than 
controls in four of five SBE areas, none of the differences was significant. 
Attrition Hate . 

Tutored and control students were compared on the basis of whether they 
remained to complete the nursing program or whether they dropped out. Fifty 
percent of the students who received tutoring graduated from one of the four 
associate degree nursing program. Thirty-nine percent of the students who 
received no tutoring graduated. A 2 x 2 chi-square analysis of attrition by 
tutored and control students revealed that this difference was not significant. 
(Chi-souare = .Uo, df = 1, N.S.). 

Conclusion 

Failure in coursework is generally listed as the primary reason for 
student withdrawals at schools of nursing. Tutoring is one of several methods 
used to assist students with academic difficulties. Students invited for 
tutoring in this study were those predicted to receive low grades in specific 
courses . 

il 
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The primary emphasis during tutorin^^ sessions was to assist students in 
leaminff the material covered in the classroom. Both tutors and students 
generally felt that this objective had been met. 

In general the tutored students obtained more satisfactory grades than did 
their controls. A breakdown by course type revealed that tutoring was Bore 
effective for science courses than for psychology or fundamentals of nursing. 
Perhaps science courses such as anatomy, physiology, and microbiology are 
more amenable to tutoring because they are more structured in content. A 
further breakdown by attendance rates of the tutored students indicated that 
students who were present for the most sessions obtained higher grades than 
students who were present less frequently. This finding is similar to that of 
Glanzrock and Stahl (1971) who found a greater impact on student grades with 
an increase in amount of tutoring. 

If one looks at the longer range criteria, however, the relative effective- 
ness of tutoring does not appear to be so strong. Although SBE scores and 
attrition rates favored tutored students, differences were not significant. 
Several factors may underly this finding. Although failure ..i classvork is 
lis';ed as the major reason for student withdrawals, there are other causes 
for attrition. These include financial difficulties, dislike of nursing, poor 
motivation, and personal or family problems. If tutoring does indeed help 
students to obtain satisfactory grades in courses, these temporary gains in 
achiftvement may be offset by other factors which are responsible for students 
dropping out of the university. 

Tutoring was shown to be an effective method of increasing student 
achievement in specific courses in an associate degree nursing program. Yet 
evaluation of longer range criteria such as SBE performance and attrition rates 
yielded inconclusive results. If overall reduction in the dropout rate of 
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nursing students is the goal of an institution, then focusing upon programs 
to improve student academic performance may be a partial solution to the 
overall problem. Attention shoxdd also be given to problems that occur in 
students' personal lives. 
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APPENDIX A 
Prelect Calendar 



I. June 1970 through May 1971 

A. Gather data from cumulative records and testing for students who 
entered at four schools of nursing in 1970. 

I}. Develop multiple regression equations for predicting grades in anatomy, 
physiology, microbiology, psychology, and fundamentals of nursing. 

II. June 1971 through May 1972 

A. Gather data from cumulative records and testing for students entering in 197: 

B. Use regression equations developed in 1970 to predict grades of students 
who enter in 1971. 

C. Organize and maintain tutorial groups each semester. 

D. Develop new mxiltiple regression prediction equations from 1971 data base. 

E. Collect and analyze data each semester. 

III. June 1972 through May 1973 

A. Gather data from cumulative records and testing for students entering in 197 

B. Use regression equations developed in 1971 to predict grades of students 
who enter in 1972. 

C. Organize and maintain tutorial groups each semester. 

D. Collect and analyze data each semester. 

IV. June 1973 through October 197 ■ 

A. Obtain SBE scores of students who entered in 1971 during September 1973. 

B. Obtain SBE scores of students who entered in 1972 during September, 191^. 

C. Do final date analyses comparing tutored and control groups in terras of: 

1. Grades earned in specific courses 

2. Performance on the SBE 

3. Attrition rates 
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APPENDIX B 
ORIENTATION AND TRAINING PRINCIPLES 



1, Friendly conversation with each tutee each time. 

2, Reinforce each tutee one or more times each session. 

3, Always recofsnize a correct performance. 

1*. Never say, "That's wrong." Just show the -right way. 
5* After error, makr sure tutor does it correctly. 

6. If no response from tutee » tutor repeats in different words. 

7. Never get exasperated. 

8. Call or run down absentees. 

9. Check on assignments and tests in all courses. 

10. Discuss study habits and procedures. 

11. Watch for and inquire about personal problems. 

12. Refer if necessary; such as marital counselor. 

13. Help student identify significant information. 

ll*. A volunteer listing of "Big Sisters" will be prepared by the 

principal investigator for the tutor and the tutee 's selection of a 
Big Sister for each student. 

15. Tutee should acquaint himself (herself) with the professor of the 
scheduled course by having at least one office visit. 

16. Tutor should be available for student assistance. 



SUPERVISION 



1. Direct observation 

2. Interaction analysis 

3. Interview with each tutor 
k. One outside observer 



FINAL EVALUATIONS 



1. Student performance (grade in course). 

2. Questionnaire to each tutee. 

3. Interview with tutee. 

l*. Questionnaire to teacher of course in which tutee was enrolled. 

5. Qixestionnaire to tutor. 

6. Supervisor's views. 

7. Tutor's view (from tutor's weekly report). 



STUraatT ASSIGNMENT 



Bring textbook and class notes to each tutorial session. 
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APPENDIX C 



TUTEE QUESTIONNAIRE 

lJURSING TUTORIAL PROGRAM 
Eveluetion Form 
(Student) 

NAME ^ CITY DATE. 

SUBJECT 

1. Was your tutor helpful in learning material ir the course? 
rr Very much 
£j Quite a bit 
£J Very little 
fj^ None 

Comment . - 



2. Did your tutor know the material he (she) was helping you learn? 
/T Very well 
£J Quite well 
£7 Slightly 
£J Not at all 

Comment . . ..■ . . _ . . 



3. Did your tutor complain, scold, or criticize you or the class? 
jTj Very frequently 
£J Quite often 
rj Occasionally 
£7 Never 

Cocment , 
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Did your tutor praise or encourage you or the class? 
/ / Very frequently 
£j Quite often 
£J Occasionally 
£j Never 

Comment . ^ 



r». Did your tutor appear to "be prepared for the meetings? 
£J Always 
£T Most of the time 
rj Half of the time 
£J Occasionally 
r7 Never 

Coament . 



6. Did the tutorial classes help you in any way with your other classes in other 
subjects? 

£7 Yes 

£j Uncertain 

U No 



7. Did you have a good meeting roon? 

£7 Ye. 

£7 Ho 
Comment . . . 
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8. Did you ever get help from the tutor outside the regular sessions? 
O Yes 
O No 



9. Did the tutor help you vith preparation for tests and assignments in the course? 

/ 7 Very much 
£7 a lot 

CI Some 

[J A little 
[J Hot at all 

Conment , — ■ . 



10. Did the tutor help you find the correct approach vhen you made a mistake or 
needed help? 

O WO 

Coninent . , , , , — — 



11. Did you ever get to talk to the tutor on a friendly or personal hasis ia class 
or in his office? 

Q Y«« 
£7 Ho 

ConnMnt _ . . . ■.. . . ■ 



12. Were you erer absent from a session? 

£7 No 

Coisment ^ 



13* If you were ever absent, did the tutor call you or check on your absence? 
D Yes 

Comment . 



ll» . Did the tutor check on how well you were doing on tests or assignments in the 
course? 

rj Frequently 
fjl Occasionally 
rj Never 

Cooment _ . . . 



15. Did the tutor ever talk to you or the group about study habits or methods? 
£7 Frequently 
£J Ckscaslonally 
£J never 

Coiments - , 
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l6. Did the tutor ever encourage you or others to eo to sea the professor vho was 
teaching the course? 

n Yes 

n No 

COtDDlStlt ^ _ _ 



17. Did you have a big sister? 
n Yes 

18. Was she helpful? 
n Yes 

£7 Ho 

19. How? 



20. What special prohlems, if any, did you face in or as a result of this tutorial 
program? . i-. . . 



21. What would you do, if anything, to really improve this tutor program? 



22. How many students were in your tutored group most of the time? 

23. Rov votild you rate the size of the tutored group? 

A. / / Too laany students for tutor to really help us. 

B. / / Just right. 

C. Too few students. Tutor could do a better job if there vere loore. 
If you checked A or what would you consider the ideal number? 

24. Have you ever been in any tutorial groups since graduation from high school? 

O No 

25. What other tutorial activity have you participated in? 

Hhen_ , 

Pro a T o _■ 

What subject matter? 

26. If you answered **yetf'to 24 above » how beneficial was the tutoring in this 
program compared with other tutorial work? 

/ / This program was better than other. 

/ / This program was about equally helpful. 

/ / This program was not aa good. 
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